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METHOD AND APPARATUS TO DISPLAY VIDEO 

5 BACKGROUND 
L Field 

The patent relates to the field of displaying video in a computer system. 

10 

2. Background Information 

Digital video comprises a sequence of digital images. It is increasingly common to 
display (e.g. render) digital video in computer systems. A computer system is any device 

15 comprising a processor and a memory to store instructions and data to be supplied to the 
processor. Typically, the processor and memory are coupled by way of one or more 
buses. A collection of instructions e.g. software, may be executed to convert the bits of 
the digital video to signals to a display device, e.g. to render the video. Examples of 
display devices are monitors and flat screens, to name just a few. Many other types of 

20 display devices are well known in the art. 

Software may generate a windowed interface on the display device. The windowed 
interface may include windows with elements such as borders, title bars, buttons, sliders, 
and icons, to name just a few of the possibilities. Versions of the Microsoft™ 
25 Windows™ operating system, a product of Microsoft corporation, are examples of 

programs which produce windowed interfaces. Window elements are typically displayed 
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on the "foreground" of a window; areas of the window in which display elements are not 
present are referred to as the "background" of the window. Rendering video on 
windowed interfaces is complicated by the need to coordinate the rendering of the video 
with the position and operation of windows and elements of the windows. 

5 

Existing techniques for rendering video on computer system displays may obscure or 
interfere with the operation of elements of the windowed interface. There is a continuing 
need for a manner of rendering video in the "background" of a window so that it does not 
interfere with the display or operation of windows. 

10 

SUMMARY 

In one aspect, a method includes creating a first window to receive video which at least 
15 partially overlaps a second window on a region of overlap of the display. Pixels of the 
first window are set to a chroma color. Background pixels of the second window in the 
region of overlap are also set to the chroma color. The second window is configured to 
draw after the first window. 

20 

BRIEF DESCRIPTION OF THE DRAWINGS 

The subject matter regarded as the invention is particularly pointed out and distinctly 
claimed in the concluding portion of the specification. The invention, however, may be 
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further understood by reference to the following detailed description read with reference 
to the accompanying drawings. 

Figure 1 shows a method embodiment in accordance with the present invention. 

5 

Figure 2 shows an apparatus embodiment in accordance with the present invention. 
Figure 3 shows a method embodiment in accordance with the present invention. 

10 

DETAILED DESCRIPTION 

The embodiments described herein are merely illustrative, and one skilled in the art will 
appreciate that numerous modifications can be made which nonetheless fall within the 
1 5 scope of the present invention. 

Figure 1 shows a method embodiment 100 in accordance with the present invention. An 
Hypertext Markup Language (HTML) document 104 is received by browser software 
102. In one embodiment, the HTML document 104 comprises a tag comprising a 
20 Uniform Resource Locator (URL) identifying a TV "scheme" (also referred to as a TV 
protocol) such as: 

<BODY background="tv:"> 
</BODY> 
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In one embodiment the source of the video to render for a TV scheme is pre-configured, 
such that it is not necessary to identify a domain name, path, or filename in the URL. Of 
course, other embodiments could fully or partially specify the video source in the URL. 

5 The tag may apply to the background of the entire document 104 or to an element of the 
document 104 such as a cell in a table. Browser software 102 creates software 106 are 
receives background tile 112 from software 106. Browser 102 may be configured to 
create software 106 when the "TV scheme" is encountered within a document 104. 
Software 106 may be referred to as a "scheme handler", "protocol handler", or more 

10 specifically, a "TV scheme handler". Manners of creating and configuring scheme 
handlers for browsers, such as the Microsoft Internet Explorer™ or the Netscape™ 
Navigator™ are well known in the art. Background tile 112 comprises a sequence of 
bits to duplicate across the background area of the element comprising the TV scheme. 
Background tile 112 may comprise a solid color, known as the chroma-key color for the 

15 video. Background tile 112 may be applied to areas of the browser window 1 18 to which 
video is to be rendered. Browser software 102 parses HTML document 104 and renders 
the HTML within browser window 1 1 8 on a display of computer system. 

Video window 114 comprises an area of the display where video is to be rendered. Video 
20 window 1 14 comprises some or all of browser window 118. Background tile 1 12 is 

applied across all of the region of browser window 118 comprised by video window 114. 
Note that browser window 118 and video window 1 14 are separate display elements, that 
is, they are treated as separate windows for purposes of managing the windowed display. 
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For example, in a computer system running Microsoft Windows 2000™, browser 
window 118 and video window 1 14 comprise separate "logical windows" each with their 
own window handle, in manners well known in the art. 

5 In one embodiment, browser software 102 does not apply background tile 1 12 to video 
window 114. Rather, background tile 1 12 is applied to the region of browser window 
118 comprised by video window 114. This distinction will be described more fully 
below. Once the document 104 is parsed and ready to be rendered, browser 102 notifies 
browser helper software 108. Browser helper software 108 is software configured to 

10 operate in conjunction with browser software 102 upon the occurrence of certain events 
(such as the completion of parsing of an HTML file). Manners of creating and 
configuring browser helper software 108 for popular commercial browsers are well 
known in the art. Browser helper software 108 starts the video control software 110 with 
an indication of the location and extent of the video window. For example, in a Microsoft 

15 Windows environment a function call resembling the following might be used to start 
video rendering: 

RunVideo(HWND hBrowserWindow, RECT *tvWindowExtent); 

20 Here hBrowserWindow is a variable representing a software handle to the data structure 
(e.g. Microsoft Windows logical window) representing the browser window 118. The 
video control software 110 may use this window handle to configure the video window 
1 14 and browser window 118 with a common parent window. Reasons for doing this are 
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described in conjunction with Figure 3 below. The variable tvWindowExtent describes a 
rectangular area of the display where video window 1 14 will be displayed. Once 
rendering is started, video control software 1 10 renders video to video window 1 14. 

5 While the embodiment 100 of Figure 1 is described in terms of HTML documents and 
browsers, the invention is not limited to this specific application. The invention may 
operate with any type of document and any software with a window onto which 
background video is to be rendered. 

10 Figure 2 shows an apparatus embodiment 200 in accordance with the present invention. 
Embodiment 200 comprises a processor 202 coupled to a controller 204 by way of a 
processor bus 222, commonly referred to as a front side bus. Bus controller 204 is 
coupled to memory 206 via memory bus 224. Bus controller 204 is also coupled to 
various peripheral devices such as mass storage 214, network interface 226, and display 

15 208 via I/O bus 228. Network interface 226 provides apparatus 200 with access to 
networks such as the Internet or corporate intranets. 

Memory 206 stores browser software 212, browser helper software 316, TV scheme 
handler 218, and video control software 234. Memory 206 is typically a form of random 
20 access memory (RAM), although in some embodiments memory 206 could comprise 
non- volatile memory such as a hard disk, flash memory, or CD ROM. Memory 206 
supplies the instructions of software stored therein to processor 202 for execution. Of 
course, mass storage 214 may store archived versions of browser software 212, browser 
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helper software 216, TV scheme software 218, video control software 234 stored in 
memory 206. 



Execution of browser software 212 and video control software 224 by processor 202 
5 results in display of browser window 230 and video window 232 on display device 208. 

Figure 3 shows a method embodiment 300 in accordance with the present invention. 
Embodiment 300 operates to render video in the background of a window in a windowed 
user interface environment. Three windows are involved; a video window, an application 
10 window, and a parent window of the application window. A parent window is a window 
whose position on a display device has a controlling effect on the position of child 
windows of the parent. Child windows are windows which have the parent window as a 
parent. 

15 At 302 video window is hidden, that is, removed from the display. Video window is the 
window into which the video is rendered. At 304 a parent window of the application 
window is retrieved. In embodiment 300 the application window is a window associated 
with an application program, that is, some program that performs a task under the 
direction on a human user. Of course, the invention is in no way limited to application 

20 programs and in general applies to any software which uses windows including Java 
applets, component object model (COM) software, software libraries, and so on. Parent 
window of the video window is set to the parent window of the application window at 
306. In other words, the video window is set to be a child of the same window that the 
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application window is a child of. The parent window determines the position of child 
windows on the display. Whenever the parent window is moved, child windows are 
moved correspondingly. Setting the application window and the video window with a 
common parent results in the relative position of the application window and video 
5 window being maintained when one or the other is moved. 

Other embodiments might not employ a common parent window for both the application 
and video windows. Other mechanisms may be employed to coordinate displacement of 
the video and application windows, so long as such mechanisms do not interfere with the 
10 order in which the windows are drawn, as described below. 

At 308, the application window style is set to "transparent". This does not necessarily 
mean that the elements of the window, or the window itself, becomes invisible or hidden 
from view. Rather a "transparent" style indicates that when the application window is one 

15 of a set of child windows (e.g. siblings) on the display, the application window along 
with its elements are drawn last. In other words, the elements of the application window 
are always drawn on top of any other sibling windows with which they share an area of 
the display. In order for the video to render upon the background of the application 
window, the video window and application window overlap to some extent. The 

20 application window has a style of transparent and thus draws after the video window 
draws whenever the portion of the display containing the application window and video 
window, or a portion of them, is "invalidated". This may occur, for example, when the 
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application and video windows are moved or when they are occluded or partially 
occluded by another window and later un-occluded. 

To understand the effect of setting the application window style to transparent, it is 

5 helpful to examine how video is rendered in embodiment 300. A video window is 
established to receive the rendered video. The video window corresponds to a 
rectangular area of the display (other embodiments might support non-rectangular 
displays). This rectangular area comprises a collection of pixels, e.g. points on the 
display which may be illuminated with color. The pixels of the video window are first 

10 set to the chroma key color. During video rendering, each pixel within the extent of the 
video window region which has the chroma key color is set to the color of the video in 
that position. When a pixel is encountered which is not the chroma key color, that pixel is 
skipped and not set to the video color. The application window or a portion thereof has a 
background which is also set to the chroma key color. Elements of the application 

15 window which overlap the video window and which are not set to the chroma key color 
are not overwritten with video. For example, there may be buttons, icons, text, or other 
elements which are black in color, whereas the chroma key color may be cyan or 
magenta. These display elements will appear in the "foreground" whereas the video 
appears in the "background", because the video will not replace the pixels of these 

20 elements. 

When a display area comprising the video and application windows or a portion thereof is 
invalidated, the video window or portion thereof is drawn first. In one embodiment, 
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drawing the video window involves first setting pixels in the invalidated region with the 
chroma key color, and then rendering the video by setting each chroma key colored pixel 
to the color of the video at that pixel location. Drawing the application window involves 
setting each background pixel in the invalidated area to the chroma key color, and then 

5 drawing elements of the application window over this background. Thus, in one 

embodiment at least some pixels of the video window may be set to the chroma key color 
twice. Any chroma key colored pixels in the invalidated region are replaced with video. 
Consequently, elements of the application window which are not the chroma key color 
are drawn last and are not replaced with video. Video thus appears to render in the 

10 background of the application window and does not obscure the elements of the 
application window. 

At 310 the video window is shown, that is, made visible on the display. At 312 the 
application window is brought to the "top" of any set of overlapping windows. In 
15 embodiment 300, bringing the application window to the top is a mechanism to make the 
application window responsive to user input activities such as mouse clicks and keyboard 
button presses. Other embodiments may of course employ other techniques to make the 
application window responsive. 

20 While certain features of the invention have been illustrated as described herein, many 
modifications, substitutions, changes and equivalents will now occur to those skilled in 
the art. It is, therefore, to be understood that the appended claims are intended to cover all 
such embodiments and changes as fall within the true spirit of the invention. 
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What is claimed is: 

1 . A method comprising: 

creating a first window to receive video which at least partially overlaps a second 

window on a region of overlap of a display; 
setting the pixels of the first window to a chroma color; 
setting background pixels of the second window in the region of overlap to the 

chroma color; and 
configuring the second window to draw after the first window. 

2. The method of claim 1 further comprising: 

configuring the first and second windows as children of a common parent window. 

3. The method of claim 1 further comprising: 

configuring the second window to receive user interface events. 

4. The method of claim 1 in which configuring the second window to draw after the first 
window further comprises: 

setting the style of the second window to transparent. 

5 . A method comprising: 

creating a first window which at least partially overlaps a second window in a region 
of overlap on a display; 
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configuring the first and second windows to move correspondingly to one another; 
configuring the first and second windows such that the region of overlap is always 

drawn first with a chroma color and then drawn with other colors representing 

window elements; and 
rendering video only to areas of the region of overlap which have the chroma color. 

6. The method of claim 5 further comprising: 

configuring one of the first and second windows to receive user interface events. 

7. An article comprising: 

a memory having stored thereon instructions which, when executed by a processor, 
result in 

creating a first window to receive video which at least partially overlaps a second 

window on a region of overlap of a display; 
setting the pixels of the first window to a chroma color; 
setting background pixels of the second window in the region of overlap to the 

chroma color; and 
configuring the second window to draw after the first window. 

8. The article of claim 7 in which the instructions, when executed by the 

processor, further result in: 
configuring the first and second windows as children of a common parent window. 
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9. The article of claim 7 in which the instructions, when executed by the processor, 
further result in: 

configuring the second window to receive user interface events. 



1 0. The article of claim 7 in which the instructions, when executed by the processor 
to configure the second window to draw after the first window, result in: 
setting the style of the second window to transparent. 

1 L An article comprising: 

a memory having stored thereon instructions which, when executed by a processor, 
result in 

creating a first window which at least partially overlaps a second window in a region 
5 of overlap on a display; 

configuring the first and second windows to move correspondingly to one another; 
configuring the first and second windows such that the region of overlap is always 

drawn first with a chroma color and then drawn with other colors representing 

window elements; and 

10 rendering video only to areas of the region of overlap which have the chroma color. 

12. The article of claim 1 1 in which the instructions, when executed by the processor, 
further result in: 

configuring one of the first and second windows to receive user interface events. 

13. A system comprising: 
a processor; 
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a memory coupled to the processor by way of a bus, the memory having stored 
thereon instructions which, when executed by a processor, result in 
creating a first window which at least partially overlaps a second window in a 

region of overlap on a display; 
configuring the first and second windows to have a common parent window; 
configuring the first and second windows such that the region of overlap is always 

drawn first with a chroma color and then drawn with other colors 

representing window elements; and 
rendering video only to areas of the region of overlap which have the chroma 

color. 

14. The system of claim 1 3 in which the instructions, when executed by the 
processor, further result in: 

configuring one of the first and second windows to receive user interface events. 

15. The system of claim 13 in which the instructions, when executed by the processor 
to configure the first and second windows such that the region of overlap is always drawn 
first with a chroma color and then drawn with other colors representing window 
elements, result in: 

setting the style of one of the first and the second windows to transparent. 
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ABSTRACT 



A method includes creating a first window to receive video which at least partially 
overlaps a second window on a region of overlap of the display. Pixels of the first 
window are set to a chroma color. Background pixels of the second window in the region 
of overlap are also set to the chroma color, The second window is configured to draw 
after the first window. 
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Robert Andrew Diehl, Reg. No. 40,992; Sanjeet Dutta, Reg. No. P46,145; Matthew C. Fagan, Reg. No. 37,542; Tarek N. 
Fahmi, Reg. No. 41,402; Paramita Ghosh, Reg. No. 42,806; James Y. Go, Reg. No. 40,621; James A. Henry, Reg. No. 
41,064; Willmore F. Holbrow III, Reg. No. P41,845; Sheryl Sue Holloway, Reg. No. 37,850; George W Hoover II, Reg. 
No. 32,992; Eric S. Hyman, Reg. No. 30,139; William W. Kidd, Reg. No. 31,772; Sang Hui Kim, Reg. No. 40,450; Eric T. 
King, Reg. No. 44,188; Erica W. Kuo, Reg. No. 42,775; Kurt P. Leyendecker, Reg. No. 42,799; Michael J. Mallie, Reg. 
No. 36,591; Andre L. Marais, under 37 C.F.R. § 10.9(b); Paul A. Mendonsa, Reg. No. 42,879; Darren J. Milliken, Reg. 
42,004; Lisa A. Norris, Reg. No. 44,976; Chun M. Ng, Reg. No. 36,878; Thien T. Nguyen, Reg. No. 43,835; Thinh V. 
Nguyen, Reg. No. 42,034; Dennis A. Nicholls, Reg. No. 42,036; Daniel E. Ovanezian, Reg. No. 41,236; Marina Portnova, 
Reg. No. P45/750; Babak Redjaian, Reg. No. 42,096; William F. Ryann, Reg. 44,313; James H. Salter, Reg. No. 35,668; 
William W. Schaal, Reg. No. 39,018; James C. Scheller, Reg. No. 31,195; Jeffrey Sam Smith, Reg. No. 39,377; Maria 
McCormack Sobrino, Reg. No. 31,639; Stanley W. Sokoloff, Reg. No. 25,128; Judith A. Szepesi, Reg. No. 39,393; 
Vincent P. Tassinari, Reg. No. 42,179; Edwin H. Taylor, Reg. No. 25,129; John F. Travis, Reg. No. 43,203; George G. C. 
Tseng, Reg. No. 41,355; Joseph A. Twarowski, Reg. No. 42,191; Lester J. Vincent, Reg. No. 31,460; Glenn E. Von 
Tersch, Reg. No. 41,364; John Patrick Ward, Reg. No. 40,216; Mark L. Watson, Reg. No. P46,322; Thomas C. Webster, 
Reg. No. P46,154; Charles T. J. Weigell, Reg. No. 43,398; Kirk D. Williams, Reg. No. 42,229; James M. Wu, Reg. No. 
45,241; Steven D. Yates, Reg. No. 42,242; and Norman Zafman, Reg. No. 26,250; my patent attorneys, and Justin M. 
Dillon, Reg. No. 42,486; my patent agent, of BLAKELY, SOKOLOFF, TAYLOR & ZAFMAN LLP, with offices located 
at 12400 Wilshire Boulevard, 7th Floor, Los Angeles, California 90025, telephone (310) 207-3800, and Alan K. Aldous, 
Reg. No. 31,905; Robert D. Anderson, Reg. No. 33,826; Joseph R. Bond, Reg. No. 36,458; Richard C. Calderwood, Reg. 
No. 35,468; Jeffrey S. Draeger, Reg. No. 41,000; Cynthia Thomas Faatz, Reg No. 39,973; Sean Fitzgerald, Reg. No. 
32,027; John N. Greaves, Reg. No. 40,362; Seth Z. Kalson, Reg. No. 40,670; David J. Kaplan, Reg. No. 41,105; Charles 
A. Mirho, Reg. No. 41,199; Leo V. Novakoski, Reg. No. 37,198; Naomi Obinata, Reg. No. 39,320; Thomas C. Reynolds, 
Reg. No. 32,488; Kenneth M. Seddon, Reg. No. 43,105; Mark Seeley, Reg. No. 32,299; Steven P. Skabrat, Reg. No. 
36,279; Howard A. Skaist, Reg. No. 36,008; Steven C. Stewart, Reg. No. 33,555; Raymond J. Werner, Reg. No. 34,752; 
Robert G. Winkle, Reg. No. 37,474; and Charles K. Young, Reg. No. 39,435; my patent attorneys, and Thomas Raleigh 
Lane, Reg. No. 42,781; Calvin E. Wells; Reg. No. P43,256, Peter Lam, Reg. No. 44,855; and Gene I. Su, Reg. No. 45,140; 
my patent agents, of INTEL CORPORATION; and James R. Them, Reg. No. 31,710, my patent attorney; with full power 
of substitution and revocation, to prosecute this application and to transact all business in the Patent and Trademark Office 
connected herewith. 
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